Question Answering Evaluation Survey
نویسندگان
چکیده
Evaluating Question Answering (QA) Systems is a very complex task: state-of-the-art systems involve processing whose influences and contributions on the final result are not clear and need to be studied. We present some key points on different aspects of the QA Systems (QAS) evaluation: mainly, as performed during large-scale campaigns, but also with clues on the evaluation of QAS typical software components; the last part of this paper, is devoted to a brief presentation of the French QA campaign EQueR and presents two issues: inter-annotator agreement during campaign and the reuse of reference patterns.
منابع مشابه
Investigating Embedded Question Reuse in Question Answering
The investigation presented in this paper is a novel method in question answering (QA) that enables a QA system to gain performance through reuse of information in the answer to one question to answer another related question. Our analysis shows that a pair of question in a general open domain QA can have embedding relation through their mentions of noun phrase expressions. We present methods f...
متن کاملBoosting Passage Retrieval through Reuse in Question Answering
Question Answering (QA) is an emerging important field in Information Retrieval. In a QA system the archive of previous questions asked from the system makes a collection full of useful factual nuggets. This paper makes an initial attempt to investigate the reuse of facts contained in the archive of previous questions to help and gain performance in answering future related factoid questions. I...
متن کاملA New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression
The development of computer systems and extensive use of information technology in the everyday life of people have just made it more and more important for them to make quick access to information that has received great importance. Increasing the volume of information makes it difficult to manage or control. Thus, some instruments need to be provided to use this information. The QA system is ...
متن کاملA Survey of Natural Language Question Answering System
In Question answering (QA) system retrieves the precise information from large documents according to user query. This survey paper describe the different methods of natural language question answering system (NLQA) for general languages.QA System automatically retrieve correct responses to the question asked by the human in natural languages.
متن کاملUsing Logic Proofs to justify answers in Open-Domain Question-Answering system
In an open-domain question answering (QA) system, we can have any type of questions (e.g. factoid, list, definition, etc) on any subject topic (starting from sports to medical, news, programming language, tea, weather, cooking, literally anything!). To understand the complex questions and to find the accurate answers for these questions, we need deeper text understanding among question, answer ...
متن کامل